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ABSTRACT 

The purpose of this pilot study was to test the 
hypothesis that the mean number of correct responses to pictorial 
items (line drawings) would be significantly higher than the mean 
number of correct responses to verbal (printed word) items. The items 
tested were selected from the items included in a posttest 
administered to 33 first grade students aftev they vieued a short 
film entitled "The Three Little Pigs," Subjects, enrolled in special 
courses for the educable mentally handicapped, had IQ's of from 54 to 
88. An ex post facto research design was used to evaluate data 
collected by the Computer Based Project in the evaluation of media 
for the handicapped. Analysis revealed that, contrary to the 
hypothesis, the mean score on word items was greater than the mean on 
pictorial items. Because of limitations of the study, it is suggested 
that the exercise was more of a learning situation than an 
opportunity to contribute useful and meaningful experimental 
evidence, (WD R) 
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ABSTRACT 



The purpose of this pilot study was to analyze the 
difference in mean scores for pictorial (line drawings) 
and verbal (printed words) stimuli as evoked on a post 
test administered to educable mentally retarded (EMR) 
first graders. An ex post facto, research design was 
used to evaluate data collected by the Computer Based 
Project in the evaluation of media for the handicapped. 
Statistical analysis of the data revealed that the mean 
for correct responses on word items was greater than 
the mean for correct responses on pictorial items. The 
limitations of the study are discussed* and suggestions 
are offered for further research. 
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T i 1" I 8 \ PICTORIAL VS. VERBAL STIMULI IN POSTTEST ITEMS 

BY : Harold G. Lord 
BACKGROUND 

The Computer Based Project for the Evaluation of Media for the Handicapped, 
based on contract #0EC-9-423617-4357 (616) between the Syracuse (N.Y. ) City School 
District and the Media Services and Captioned Films Branch, Bureau of Education 
for the Handicapped (United states Office of Education) for the five year period 
July 1, 1969 through June 30, 1974. The major goal is to improve the instruction 
of handicapped children through the development and use of an evaluation system 
to measure the instructional effectiveness of films and other materials with 
educable mentally handicapped (EMH) children, in-service training and media support 
for special teachers, and studies related to the evaluation process and the 
populations used. 



The Project has concentrated on the 600 films and 200 filmstrips from the 
Media Services and Captioned Films (BEU - USOE) depository; however, specific 
packages from Project LIFE, various elementary math curricula, and selected 
programs from Children's TV Workshop have also been evaluated. The evaluation 
model used requires that: .1) objectives of materials be specified and written; 
2) instruments be constructed to test and measure effectiveness? and> 3) children 
be the major sources of evaluation information. A number of instruments and 
methodologies are employed in the gathering of cognitive and affective data from 
900 EMH children and 80 special teachers to make the effectiveness decisions. 
Over half of the EMH population can neither read or write; therefore, a unique 
Student Response System (SRS) its employed, consisting of a twenty station G.E.- 
1000 SRS which can be operated in a group or individual recording mode and is 
connected to a remote computer system. The computer capabilities consist of 
remote telephone connections to the Rome (N.Y.) Air Development Command, the 
Honeywell time-shared network, and the Schenectady (N.Y.) G E Research and 
Development Center; and batch mode capabilities of the Syracuse City Schools, 
Syracuse University, and various commercial sources. 



In-service and media support activities provide on-the-job training for 
teachers, teacher aides, equipment, and materials to the special teachers in 
the city schools. The research activities have centered around investigations 
and special problems related to the development of the evaluation model. Ihe 
four major areas considered are: 1) testing effects, 2) captioning effects, 
3) special student characteristics; and, 4) evaluation procedures validation. 

Documentation of the major activities appear in the five annual reports 
and the 600 evaluations prepared on materials used. Staff members were encouraged 
to prepare special reports and the attached paper is one of these. The opinions ■ 
expressed in this publication do not necessarily reflect the position or policy 
of the Computer Based Project, the United States Office of Education, or the 
Syracuse City School District, and no official endorsement by any of the agencies 
should be inferred. 



July 19 73 



PICTORIAL VS. VERBAL STIMULI IN POSTTEST ITEMS 

The pracbice of using pictures in bhe presentation 
of instructional materials is based, at least in part, upon 
the assumption that pictures clarify verbal descriptions 
and that they present more realistic stimuli . Yet research 
has shown that verbal and pictorial presentations of the 
same stimuli can evoke different, even conflicting response 
(e.g., Samuels, 1970). 

It seems generally assumed that, in terms of direct 
sensory appeal, stimuli presented .pictorially are superior 
to those read in printed words or heard in spoken words. 
This assumption has led to numerous current practices and 
procedures in utilization of audiovisual materials, not onl 
in education but also in business, industry, and mass com- 
munication. People are constantly bombarded with materials 
pictorially presented in books, magazines, newspapers, post 
ers, movies, and over television. Pictures of one kind or 
another, either presented alone or together with written 
and/or spoken words, are abundantly utilized in textbooks 
and instructional materials under the assumption that they 
facilitate learning by appealing directly to sensory and 
cognitive reactions of the learners. 
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According to Bourisseau, Davis, and Yarnamoto (1965) . 
''the assumption that pictures are indeed more effective 
than prinbecl words in both the presentation of information 
and the evocation of sensory responses is a conclusion sup- 
ported more by faith than by facts [p. 250]. " Most related 
research findings are not really relevant, for their empha- 
sis has been on preferences of one or the other mode of pre- 
sentation (Allen, 1960). Yetj on the basis of preferences 
and belief in the idea of pictorial superiority over words, 
instructional materials have been revolutionized to reflect 
this assumption. This idea has persisted in the absence of 
solid research evidence, and has achieved a prominent and 
seldom-disputed position in general audiovisual theory. 

The purpose of this pilot study is to analyze the 
difference in mean scores for pictorial (line drawings) 
and verbal (printed words) stimuli as evoked on a post 
test administered to mentally retarded first graders. Hope- 
fully from this analysis, empirical evidence will be provided 
to 'determine if^in fact^ there is support for the assumption 
that pictorial stimuli are superior to verbal stimuli. 



Review of Related Literature 



Words and pictures are st imul i , What is learned from 
them depends on the kinds of responses that they elicit. 
According to May (1965) , for the convenience of exposition, 
responses can be put into three major categories. In the 
first category are all preparatory responses of attention, 
selective d iscr imination^and perception which presumably 
have been learned previous to the presentation. Second are 
the responses involved in learning what the presentation 
purports to teach. These are called acquisition responses . 
In the third category are the responses involved in anchor- 
ing what has been learned so that it can be used on subse- 
quent occasions » These are called consoli dating r esponses » 
For the purpose of this study, only responses involved in 
the acquiri ng of new information, skills, concepts, and un- 
derstandings will be dealt with. 

Acquisition responses are specified by learning tasks 
(May, 1965) . If the task is to reproduce the material verba- 
tum from memory (recall) , the responses required to perform 
it are different from those that would be required to pro- 
duce evidence that the substance of the material had been 
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comprehended. The same is true for mere recognition re- 
sponses . 

Lumsdaine (19 58) prepared a large number of pairs of 
unrelated words, pairs of unrelated pictures, pairs of pic- 
tures and words, and pairs of words and pictures. The pairs 
were presented in random order, 16 pairs to each list^ to 
intermediate grade school children and to college students. 
The experimental conditions were varied in respect to rate 
of presentation and in other respects. The members of each 
pair were selected to minimize previously learned associa- 
tions. The learning task was mainly that of" rote memorizing. 
It was found that under all conditions and for different ' 
grade levels of students, picture-word pairs were learned 
best, word-picture pairs least, with word-word and picture- 
picture in between. Lumsdaine interpreted these findings 
as supporting his hypothesis that pictures are superior stim- 
ulus information for association and inferior response in- 
formation, whilo words are superior response information 
and inferior stimulus information. Words are poorer stim- 
ulus terms than pictures mainly because they are apt to have 
more than one meaning; words are better response terms than 
pictures partly because most people have had a great deal 



more experience in seeing an object or picture, before hear- 



ing or seeing its name (May, 1965) . 

Bern (1958) changed the criterion task from recall 
to discrimination, presenting both words and pictures in 
the test situation, he found that for the performance of 
this task, picture-picture and word-picture were superior 
to word-word and to picture-word. Thus it would appear that 
when the criterion task is changed the associations that med- 
iate the correct responses are different . Bern 1 s finding 
of better performance for conditions involving pictorial 
response with the introduction of pictorial testing is in 
agreement with the stimulus and response generalization hy- 
pothesis for presentation and testing conditions (see 
Kerlinger, 1964, pp. 323-324) . 

According to Hartman (1961) who reviewed the litera- 
ture on multiple channel association learning: 

To derive their hypotheses, both Lumsdaine and 
Bern have postulated chains of intervening sub- 
associations between the stimulus and the response 
information to ba associated. Lumsdaine cites a 
study by pan (1926) which indicated that better 
association between unrelated words could be 
achieved by providing words that mediated be- 
tween stimulus and response . Lumsdaine 1 s deriva- 
tion is quite complex, and the following simpli- 
fication is perhaps an injustice. Pictures make 
good stimuli because they do not evoke competing 



b 



verbal associations. Words, on the other hand, do 
evoke competing verbal associations, and for this 
reason, are poor in the stimulus position. Words, 
according to Lumsdaine, make better responses than 
pictures because they possess a greater variety of 
associations which can be attached to the stimulus. 
Second , verbal associations are less specific than 
pictorial associations and , therefore , are easier 
to attach to a given stimulus [p. 251]. 

The role of mediators in paired-associate learning 

was investigated in an experiment by Davidson (1964) . The 

materials were pairs of pictures of objects familiar to sixty 

second grade school children who served as subjects. They 

were divided into, high and low ability groups based on the 

results of a preliminary experiment in which they were tested 

for initial abilities to form associations between pairs of 

pictures. Each of the two groups was assigned at random to 

five experimental conditions. For each condition twenty 

pairs of pictures were exposed at the rate of a pair every 

five seconds. There followed two test trials during which 

only the stimulus picture was exposed^ the task was to 

cioose from four pictures in a workbook the one that belonged 

to the sti^jtilus picture . On the second tr ial the order of 

presentation was changed. For condition A no mediators were 

employed. For condition B the experimenter pronounced the 

names of the two pictures (e.g., 41 chair 11 — "shoe") on the 
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presenbabion brials, bub not on bhe besb brials. Condition 
C was bhe same except bhe experimenber inserbed a preposition 
bebween bhe pairs (e.g., "chair under shoe"). For condibion 
D a mediabing senbence was used such as "the chair doesn't 
look large under a big shoe. 11 For condition E the picbure 
showed a big shoe on a chair* The mean scores took a large 
jump beginning with condition C where connective mediabors 
were inbroduced. For bhe high abiliby groups bhe jump was 
from a mean of 13 bo 33, and for bhe low abiliby groups it 
was from 10 bo 26. Ab bhe level of conditions D and E where 
senbences and pictures ' were the mediators the low ability 
groups had combined mean score almost as high as the combined 
means of the high ability groups. When pictures of relations 
(such as ,J a big shoe on a chair") were added to sentences, 
the combined mean score of both groups went up four points , 
The study showed that there can be highly significant facil- 
itation as a result of introducing mediating links. 

Other experimenters have been concerned with differ- 
ent aspects of pictorial and verbal presentations of stimuli. 
Karwoski, Gramlich, and Arnott (1944) found longer reaction 
time to pictures than to words or objects. They suggested 
that picture stimuli require more interpretabion . 



8 

Otto (1962) found that verbal and pictorial presenta- 
tions of stimuli will result in significant differences in 
both the number and nature of responses evoked. The re- 
sponse of eighty fourth graders to pictorial (line drawings) 
and to verbal (words) stimuli failed to support the expecta- 
tion that good readers would give more responses to verbal 
stimuli and poor readers more responses to pictorial stimuli. 
It was clear that the particular stimuli involved determined 
the magnitude of difference between pictorial and verbal items 
and not a rtudent characteristic. Otto suggested that experi- 
menters should be able to predict with accuracy the extent 
to which verbal, pictorial, or verbal-pictorial stimuli will 
facilitate the attainment of particular concepts. Naturally 
much more must be known before such prescription can be 
applied. 

A picture of an object and the word-name of the same 
object do not necessarily elicit the same responses. Yet, 
in practice it is almost routinely assumed that a picture 
reinforces a verbal description and vice versa. Otto (1964) 
presented data which implied that the contrary may be true: 
a picture may in fact present clues that tend to detract 
from and to contradict verbal descriptions. He suggested 



further studios to clarify the role of pictures in concept 
attainment was needed. In another study, Bourisseau, Davis, 
and Yamamoto (1965) concluded that pictures may well be more 
restrictive than words in a person's information-processing 
system. 

The contradictory nature of existing knowledge in 
regard to pictorial and verbal stimuli suggests that serious 
further study and experimentation in this area is needed. 

Objective of the Study 

After a group of mentally retarded first grade stu- 
dents view a film and are administered a posttest, the mean 
of correct responses for pictorial items will be significantly 
higher than the mean of correct responses foreword items as 
measured on selectively sampled items. This pilot study is 
to be conducted as an ex post facto research project using 
data made available through the facilities of the Computer 
Based Project of the Syracuse (New York) Public Schools 



Methods 

A description of the procedures used in this ex post 
facto pilot study follows: 

Subjects 

The subjects were thirty-three (N=33) first grade 
students enrolled in the mentally retarded special education 
courses of the Syracuse (New York) Public School during the 
school year 1972-1973. Intelligence guotions ranged from 
54 to 88 as measured on the full score composite Stanford- 
Binet Intelligence Quotion Test. No effort was made to in- 
clude further demographic information in the study (e.g., 
sex, age, reading ability, etc*)*" , 

Procedures and mat erials 

The subjects in a group were shown a ten (10) minute, 
color, 16mm film, entitled "The Three Little Pigs." The pro- 
duction of the film was done by Coronet Films. The content 
was the fable about the efforts of three little pigs to out- 
wit a hungry wolf. The animal characters were portrayed in 
animation and live action. The following annotation for tho 
film was taken from The 16mm Film C a talog, Computer Based 
Pro j fee b; 



1033 THREE LITTLE PIGS, THE 

The film presents the familiar story of the three 
little pigs, how they go out to seek their fortune, 
and how the third little pig cleverly outwits the 
big bad wolf. Real animals and people are used to 
portray the story along with some pictures from the 
story book [p. 5] » 

Immediately after the showing of the film a written 

. •-' — k 

test of ten (10) items was administered to each subject. 
Five of the test items were pictorial and five were verbal. 
Items #1, 2, 3, 4, and 6 were pictorial (line drawings) and 
items #5, 7, 8, 9, and 10 were verbal (recognition or recall) 
The subjects responded to the test items by answering 
through the electronic response system available at the Com- 
puter Based Project. The responses were recorded on computer 
and the scores were subsequently made available through a 
hard copy printout. 

Data 

The daba collected by the Computer Based Project was M: 
in this ex post facto study. The film files were searched 
and reviewed to obtain those media for which pictorial test 
items had been created. After the media were identified 
(i.e./ the film "The Three Little Pigs") , the student re- 
sponse sheet printouts for the posttest for that particular 



title were obtained and the data transcribed from them. 
T* n e data were separated into pictorial and verbal items and 
the response scores logged for each student. 

A comparison of the mean correct responses j:or each 
of the categories was computed. 

Correct Responses 

Pictorial Verbal 

X X 

The data was analyzed by descriptive statistics utili?, 
ing Biomedical Computer Programs for correlation with trans- 
generation description and tabulation (BMD02D) and stepwise 
regression analysis (BMD02R) . Inferential statistics were 
used to determine the parameters of the study and the degree 
of error involved. The degrees of freedom (df) was 2-1 (N-l) 
or one (1) * The analysis of variance (ANOVA) employed 
F-ratios at the .05 level of significance. The null hypothe- 
sis statement that there is no actual relationship between . 
variables was stated as follows: 

The mean for correct responses on pictorial 
items (pj will be equal to the mean for correct 
responses on word items (W) . 

5p t~ (non-d irect ional) 



Limi tat ions 

This study, since it was conducted as an ex post facto pilot 
research project, was limited to gethertnv data directly involved 
in pictorial-word responses, Some bias may exist since only les'> 
than 10% of the data available from the Computer Based Project in- 
volved responses to pictorial test items* 

No effort was made for more complete demographic information 
on the students. Some additional information was available in the 
computer files of the Computer Based Project, but this data was not 
readily able to be retrieved for the thirty-three (33) students used 
as subjects for this pilot study. Such further information would be 
valuable in des igning apt itude- treatment interaction (ATI) studies 
In the future. 
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Results 

The results from the study are presented in the follow- 
ing charts . • 

Means 

Standard 

Mode Mean deviation 

I.Q. 67.69696 6.65430 

Pictorial 2.48485 1.12141 

Word 3.15152 1.27772 

Total 5.63636 2.14794 

Contrary to the hypothesis the mean for correct re- 
sponses on word items (3.15152) was greater than the mean 
for correct responses on pictorial items (2.48485). 

The mean for intelligence quotient was 67.69696 with 
a standard deviation of 6.6543. The range of I.Q. was 54 
to 88. 

Level of Significance 

Sum of Mean F Standard 
Mode, df S quares Square Ratio Error 

Pictorial 1 21.117 21.117 0.469 6.7102 
Word 1 43.370 21.685 0.474 6.7666 
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The F-ratios of 0.469 :and 0.474 were not significant 
at the .05 level. Therefore the null hypothesis was accepted 
in this two-tailed test of significance, and the research 
hypothesis was not supported. 



Var iance-Covariance Matrix 
I.Q. Pictorial Word Total 



I.Q. 44.2802 -0.9110 

Pictorial -0.9110 1.2576 

W.->rd -0.5152 0.8617 

Total -1.4261 2.1193 



-0.5152 -1.4261 

0.8617 2.1193 

1 .6326 2 .4943 

2.4943 4.6136 



The scatter plots for pictorial-I .Q . , word-I.Q., and 
total-I.Q. yielded no discernible pattern. 

Correlation Matrix 
Mode Correlation ' 



pic to word 
Pic to total 
Word to total 
Pic to I.Q. 
Word to I.Q. 
Total to I.Q. 



.6014 
.8793 
.9089 
-.0122 
- .0606 
-.0998 



Discussion 



Since this study was a pilot study only, no attempt was made 
to hypothesize the myriad of other plausible rival causal factors. 
The subjects were restricted to two mentally retarded special educa- 
tion classes; they had been pre-selected in this grouping by their 
intelligence quotient score. This limitation would render this study 
very questionable in terms of external validity. 

This pilot study had a number of other limitations, some of 
which have already been stated* Because of time constraints, the 
experimenter chose to. accept alternatives which in some instances, 
compromised the design of the experiment. These decisions pertained 
mostly to the type and quantity of data collected. Coupling the 
weaknesses of the pilot study with the weaknesses of ex post facto 
research in general, this exercise was more of a learning situation 
than an opportunity to contribute useful and meaningful experimental 
evidence. 

Although the analysis of tire data of this study refuted 
the hypothesis, the results tended to support the find- 



ing of 0 tto (1964) and Samuels (1970) . Much more must be 
discovered about the relative contributions of pictorial 
and verbal stimuli before the contradictory nature of exist- 
ing research can be resolved, 

Hanes (1973) , in his summary of an article entitled 
"The research on how children learn from pictures, " made the 
following comment ; 

A great amount of diversity exists in the re- 
search concerned with the developmental aspects 
of children learning from pictures. The diversity 
of the research findings as well as the complexity 
of the perceptual learning process severely limits 
the number of generalizations that can be made. 
However, the initial importance of visual processing 
for learning in the young child cannot be overlooked. 
Although the young child is limited with respect to 
short-term memory storage capacity and visual pro- 
cessing strategies, it appears that pictorial repre- 
sentations are extremely useful means of information 
communication. Increased efficiency in visual pro- 
cessing may be attributed to the acquisition of pro- 
cessing strategies, increased memory capacities, and 
the increased ability to utilize subtle dimensional 
and spatial cues in pictures. Even though develop- 
mental changes in the learner contribute to the in- 
creased learning performance, attributes of the 
stimulus are also influential on learning perfor- 
mance within developmental levels. This conclusion 
is most strongly supported by the research on stim- 
ulus feequencing and on processing of complex pictures 
that utilize a number of embedded cues [pp. 19-20). 

Xn an attempt to summarize pictorial research, Levio 

(1973) contributed these comments regarding picture-word com- 



parisons : 



Pictures are superior bo words as cues for elicit- 
ing specific responses, Research has rather consis- 
tently shown that pictorial recognition memory is 
superior to recognition memory for words, that free 
recall of pictures is superior to words (even though 
recall is demonstrated verbally rather than picto- 
rial ly) , and that pictures are superior stimulus 
items in paired-associate learning. The advantages 
of pictures as cues are limited by two conditions: 
when abstract rather than concrete subject matter is 
concerned , and when the learner is lacking in visual 
literacy as in the case of young children. The tau- 
tological nature of these two frequently mentioned 
limitations is apparent if they are restated thusly: 
Words are better than pictures for referring to things 
that are not readily picturable, and words are better 
than pictures when the learner is unable to learn from, 
pictures. Words also appear to be superior to pictures 
in tasks involving sequential memory* 

Picture-word comparisons of affective responses are 
complicated by the fact that people respond emotionally 
to the physical parameters of pictures as well as to 
their referential meaning components. That is, while 
affective reactions to the words '■flower 1 ' are likely 
. . - to be the same no matter what tha. visual appearance ■ . ■ 
of the printed word, different pictures of different 
flowers may evoke quite different emotional responses, 
just as different artistic renderings of the "same" 
flower may evoke different emotional responses . The 
little empirical work done in this area indicates only 
that affective reactions to words and pictures are 
different, without shedding much light on the nature 
of the differences [pp. 38-39). 

Bracht (1970) pointed out that psychologists havo been 
too optimistic in their expectations of formulating general 
laws of learning and havo not given sufficient attention to 
individual differences. He suggested "that no single in- 
structional process provides optimal learning for all students 



(p. 627)." He stated *-hat investigations in aptitude-treatment 
interaction (ATI) are needed. Snow (1970), Salomon (1970), and 
Salomon (1971) concurred and offered a paradigm for future research. 
More recently, Davis (1973) and Schwen (1973) suggested the same 
conclusion, but they called the investigations aptitude-treatment 
analysis (ATA) . 

Future research should consider what different results, 
if any, might be obtained when the pictorial stimulus is varied 
systematically (e.g., addition of color, complexity and detail, 
photographs in lieu of drawings) as is the verbal stimulus 
(printed in various type styles and sizes and in color) and the 
picture with the accompanying word. Efforts to explore hierarch- 
ical dimensions of sensory responses to such stimuli should provide 
interesting data, as would studies of the range of responses to the 
st imul i • In addition to characteristics of the stimulus mode, 
attention must also be given to receiver characteristics. Useful 
information would include the effects of individual differences such 
as age, ethnic group membership, socioeconomic class, reading ability, 
and sex. Further investigation is needed in order to resolve the 
apparent contradictory nature of existing research in pictorial and 
verbal stimuli and subject Interaction with them, 
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